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ABSTRACT 


This  paper  discusses  the  degree  to  which  satisfaction  and 
dissatisfaction  with  military  lue  represent  directionally  opposite  aspects 
of  the  same  basic  phenomenon.  The  analysis  approach  is  to  estimate  an 
unordered  model  of  survey  responses  regarding  satisfaction  with 
military  life  from  Marine  respondents  to  the  1985  DOD  Member 
Survey.  These  estimates  Can  be  used  to  test  whether  satisfaction  and 
dissatisfaction  are  opposites  with  respect  to  a  particular  set  of  variables. 


EXECUTIVE  SUMMARY 


In  research  based  on  altitudinal  data,  there  is  a  pervasive  tendency  tu  measure 
satisfaction  and  dissatisfaction  on  the  same  scale,  implicitly  assuming  that  they  arc 
degrees  of  the  same  thing.  The  ordinality  of  attitude  survey  responses  implies  that 
dissatisfaction  is  a  kind  of  "negative”  satisfaction.  But,  in  many  instances,  there  is  no 
necessary  logical  relationship  between  satisfaction  and  dissatisfaetion.  In  fact, 
satisfaction  and  dissatisfaction  can  be  different  phenomena,  caused  by  different  variables. 

A  key  variable  in  a  recent  study  of  Marine  Coips  family  programs  was  whether 
family  services  contribute  significantly  to  the  overall  satisfaction  of  Marines  with  military 
life.  Overall  satisfaction  was  measured  by  an  ordinally  scaled  variable  taking  as  values 
"dissatisfied,”  “neither  satisfied  nor  dissatisfied,”  or  "satisfied."  Implicit  in  this  analysis, 
however,  is  a  basic  assumption  that  dissatisfaction  and  satisfaction  arc  directionally 
opposite. 

This  paper  discusses  the  degree  to  which  satisfaction  and  dissatisfaction  with 
military  life  represent  directionally  opposite  aspects  of  the  same  basic  phenomenon. 
Using  data  from  Marine  respondents  to  the  1985  DOD  Member  Survey,  a  statistical 
model  of  satisfaction  with  military  life  that  does  not  constrain  satisfaction  and 
dissatisfaction  to  be  directionally  opposite  is  estimated.  Estimates  from  this  model 
indicate  that  satisfaction  and  dissatisfaction  have  some  similar  causes  and  some  dissimilar 
ones.  These  results  therefore  suggest  that  ordered  models  of  satisfaction  are  not 
universally  appropriate,  and  that  it  may  be  necessary-  in  particular  analyses  to  consider 
satisfaction  and  dissatisfaction  as  separate  variables. 
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INTRODUCTION 

A  key  variable  in  a  recent  study  of  Marine  Corps 
family  programs  [1]  was  whether  familv  services  con¬ 
tribute  significantly  to  the  overall  satisfaction  of 
Marines  with  military  life.  Overall  satisfaction  was 
measured  by  an  ordinally  scaled  variable  taking  as 
values  "dissatisfied,''  “neither  satisfied  nor  dissatisfied,’’ 
or  “satisfied.”  Implicit  in  this  analysis  were  two  basic 
assumptions.  The  first,  which  was  examined  in  another 
paper  [2],  was  that  there  is  such  a  thing  conceptually  as 
overall  satisfaction  with  the  military  (specifically  the 
Marine  Corps),  as  opposed  to  merely  some  statistical 
average  of  a  number  of  specific  kinds  of  satisfaction. 
This  paper  focuses  or.  the  second  basic  assumption: 
that  satisfaction  and  dissatisfaction  are  directionally 
opposite  aspects  of  the  came  basic  phenomenon. 

This  paper  will  investigate  the  degree  to  which 
satisfaction  and  dissatisfaction  with  military  life  represent 
directionally  opposite  aspects  of  the  same  busic 
phenomenon.  Using  data  from  Marine  respondents  to 
the  1985  DOD  Member  Survey,  a  model  of  satisfaction 
and  dissatisfaction  will  be  estimated  that  does  not 
constrain  these  variables  to  be  opposites.  (This  paper 
docs  no:  address  she  issue  considered  in  the  companion 
paper,  of  w  ha  her  “satisfaciion"  and  “dissatisfaciion"  are 
distinct  variables  or  represent  “averages"  of  a  number  of 
types  of  satisfaction  or  dissarisfrction.)  The  un¬ 
constrained  model  will  be  compared  statistically  to  a 
model  that  constrains  satisfaction  and  dissatisfaction  to 
be  opposites.  The  paper  will  conclude  with  some 
observations  cn  the  usefulness  of  ordered  versus  un- 
ordercd  response  models  for  altitudinal  data 


(This  coding  scheme  emphasizes  that  R  is  ar  index 
variable  with  no  ordinaluv.) 

Let  the  following  model  express  the  probabilities 
of  each  outcome  ps  a  function  of  a  vector  ol  indepen¬ 
dent  variables,  xr. 

G(Pn  x) 

P[R  =  0)  =  C(0o  x) T •  (1) 

C(P,  x) 

/,(*  =  I)- 7T(]50  X)  -K  *)TG(PT7j  •  811(1 
C(P2  x) 

where  G  is  a  probability  distribution  function.  A 
computationally  convenient  distributional  assumption 
is  that  G  is  the  logistic  distribution,  in  which  case 
equation  1  specifics  a  familiar  muluiiomial  logit 
(MNL)  model.’ 

If  one  can  esumate  the  parameters  of  this  model, 
the  hypothesis  that  satisfaction  and  dissatisfaction 
are  opposites  can  be  tested  Outcomes  (R  *  \)  and 
(R  *  2)  w  ill  be  said  to  be  opposites  with  respect  to  x 
lf  Pj  *=  -&2- 

By  estimating  the  parameters  p,  and  P2  can 
construct  a  generalized  Wald  test  (see  Amemiya  [3]) 
for  the  hypothesis  that  PI  ■  -p2. 

The  test  statistic 


MODEL 

Suppose  that  satisfaction  or  dissatisfaction  with 
military  service  is  measured  by  a  survey  response 
variable  taking  as  values  “dissatisfied,”  “neither  satisfied 
nor  dissatisfied,"  or  "satisfied."  Let  these  responses  be 
represented  by  an  index  variable,  R,  which  takes  values 
as  follows: 

If  response  =  "neither  satisfied  nor  dissatisfied,” 
then  R  =  0, 

If  response  »  “dissaitsfied,"  then  R  *  1; 

If  response  -  “satisfied,"  then  R  =  2. 


CIT  =  A(P)J 


•r  5a 

1  -  V  ^  1  - 

_ i 

Ip  50  1  P_ 

-1 


*<P)  .  (2) 


where  h(.)  is  a  differentiable  constraint  function,  [5 
is  the  vector  of  estimated  parameters,  and  V  is  the 


1  This  paper  presents  a  laiher  narrowly  defined  lest  of 
wheihe.  the  P  parameters  for  satisfaction  and  dissatisfacuon 
are  equal  lo  the  negative  of  each  other  (i.e.,  whether 
satisfaction  arid  dissatisfacuon  are  opposites).  Clearly,  in  a 
more  comprehensive  effort,  the  appropriateness  of  lire  MNL 
distributional  assumption  should  be  examined.  The  logistic 
specification  for  this  multinomial  model  was  made  purely  as  a 
mailer  of  convention,  based  on  computational  convenience. 


-1 


estimated  covariance  matrix  of  the  parameters,  is 
distributed  as  %2 * *  (tf)  where  q  iti  the  number  of  con 
sirrints  repn  srnted  by  A(p). 


DATA 


Tfic  <lata  used  for  this  study  arc  the  same  used  in 
the  original  study  of  Marine  Corps  Family  Programs. 
The  1985  IX) D  Member  Survey  was  based  on  a 
random  stratified  sample  of  all  military  members  who 
were  on  active  duty  on  30  September  1984.  The 
primary  sampling  stratum  was  branch  of  service;  oilier 
strata  within  service  were  sex  and,  fer  enlisted 
personnel  only,  length  of  service  (4  to  47  months  of 
service,  and  48  months  or  more).  Within  these  strata, 
service  members  were  selected  randomly.  By  using  a 
stratified  sample  design,  il  was  possible  to  obtain 
larger  samples  of  Marine  officers  and  females  than 
would  be  drawn  using  an  unsaatificd  sample,  thus 
permitting  more  precise  analyses  of  these  groups.  A 
10-pcrccnt  random  sample  of  Marine  respondents  to 
the  1985  DOD  Member  Survey  was  drawn  to  yield  a 
dataset  of  approximately  1 ,700  observations. 


Table  1  presents  descriptive  statistics  on  the 


nriarvin^fl  .  . . 

lUVIlk 


variables  included  are  the  respondent's  age.  per¬ 
ceptions  regarding  civilian  alternatives  available  to  the 
respondent,  quality  of  miluary  effect  on  family  life, 
and  scaled  measures  of  satisfaction  with  his  military 
job.1  The  dependent  variable,  which  measures  sat¬ 
isfaction  and  dissatisfaction  with  military  life  overall, 
takes  the  values  "neither  satisfied  nor  dissatisfied,’ 
"dissatisfied.”  and  ''satisfied''  with  military  life. 


ESTIMATION  RESULTS 


Table  2  presents  maximum  likelihood  estimates 
of  the  MNL  model  specified  above.  The  model  fits 
the  data  reasonably  well,  with  a  pseudo  A-squared 
measure  of  0.358. 2  Visually  comparing  the  paramctei 


1.  These  variables  basically  are  the  same  as  those  included 
in  the  ordered  mode]  of  satisfaction  with  military  life 
estimated  in  [1]. 

2.  The  concept  of  goodness-of-fu  used  is  whether  the 

independent  variables  included  in  the  model  contribute 

significantly  to  the  likelihood  ratio  of  the  MNL  model.  It 

does  not  address,  except  indirectly,  the  reasonableness  of  the 

logistic  distnbuuonal  assumption. 


vectors  pairwise  for  the  1  and  Y  =■  2  outcomes 
(i.e.,  P,  and  P2),  one  can  see  that  statistically  signifi¬ 
cant  elements  of  these  vectors  generally  tend  to  have 
opposite  signs  and  arc  approximately  equal  in  absolute 
magnitude.  Intuitively,  this  should  indicate  that  satis¬ 
faction  and  dissatisfaction  are  opposites  with  respect 
to  those  variables.  On  the  other  hand,  there  are  two 
significant  violations  of  this  pattern,  which  suggest 
dimensions  of  greater  independence  between  the 
factors  determining  satisfaction  and  dissatisfaction 
with  military  life.  Specifically,  perceived  chances  for 
a  good  civilian  job  have  a  strong  effect  on  dissatisfac¬ 
tion  with  military  life  and  no  effect  on  satisfaction, 
while  age  exhibits  precisely  the  opposite  pattern 


Tabla  1.  Descnptive  statistics  lor  survey  data  included 
in  satisfaction  model 


Vanabie 

Mean 

Standard 

deviation 

Independent  variables. 

Satisfaction  with  pay  and 

allowance8 

3  00 

110 

Job  satisfaction8 

3.60 

1.20 

Age 

Chances  for  a  good 

28  20 

650 

civilian  job5 ** 

Dependent  variable: 

8.60 

2  60 

Neither  satisfied  nor  dissatis- 

tied  with  military  life 

0.27 

Dissatisfied  with  military  life 

0  25 

Satisfied  with  military  life 

0.48 

Number  of  observations 

1,652 

a.  Scaled  satisfaction  variable,  where 

1  m  Very  dsaatished 

2  -  Somewhat  dissatisfied 

3  -  Neither  sat),  tied  nor  dissatisfied 

4  -  Somewhat  satisfied 

5  -  Very  satisfied 

b  Scaled  perception  vanabie,  where  0  -  no  chance  of  good 
civilian  job  and  10  ■  oertainty  ol  good  avtiian  job,  if 
membei  were  to  leave  service 


Table  2.  Estimated  parametars  ol  multinomial  logit 
modal  ot  overall  satislaction  wnh  military  lila 

Outcome  variable 

Independent 


variable 

Dissatisfied 

Satisfied 

(1) 

Quality  ol  family 
environment 

-0.193* 

0.289* 

(2) 

Satisfaction  with  pay 
and  allowances 

-0  283* 

0.528* 

(3) 

Job  satislaction 

-0  349* 

0.403* 

(4) 

Age 

0.007 

0.078“ 

(5) 

Chances  lor  a  gooo 
Civilian  job 

0.080* 

0.022 

Intercept 

1 .804* 

-5.924* 

Pseudo  /^-squared:*5  0  358 

Number  at  observations.  1.652 

Test  statistic  ot  hypothesis  that  ft,  =  tor  all 
variables:  24.09  ~i2  (5) 

Test  statistic  ot  hypothesis  that 
p.  =  -p2  tor  variables  ( 1 ),  (2).  and  (3): 

7.25  -a2  (3). 


NOTE  The  omitted  category  tor  the  outcome  variable  n 
'neither  satisfied  nor  disiabslied  *  One  such  category  must 
be  omitted  to  identity  the  remaining  parameters,  which  are 
subiect  to  the  normalization  that  p  -  0  tor  the  omitted 
category 

a  Statistically  significvit  et  the  1 -percent  level 
b  As  suggested  by  Maddala.  pseudo  »  squared  u  defined  as 

1-L/"  ’ 

where  C01  it  the  sample  likelihood  ol  a  null  model  (with 
only  constant  terms)  and  Lq  is  the  sample  likelihood  ol 
the  model  at  estimated 

A  statistical  test  of  the  hypothesis  that  satisfac¬ 
tion  and  dissatisfaction  are  opposites  with  respect  to 
all  of  the  explanatory  variables  rejects  that  hypothesis: 
the  value  of  the  generalized  Wald  statistic  exceeds  the 
95  percentile  point  of  the  x3  distribution.  However, 


the  hypothesis  that  satisfaction  and  dissatisfaction  arc 
opposites  with  respect  to  quality  of  family  environ¬ 
ment,  satisfaction  with  pay  and  allowances,  and  job 
satisfaction  cannot  be  rejected  (at  the  5-pcrccnt  level 
of  significance). 

Therefore,  it  appears  that  perceptions  of  higher 
quality  family  environment,  satisfaction  with  pay  and 
allowances,  and  job  satisfaction  arc  variables  thai 
affect  overall  satisfaction  with  military  life  symmetri¬ 
cally,  in  the  sense  that  a  higher  value  of  these  vari¬ 
ables  generates  greater  overall  satisfaction  and  a  lower 
value,  more  dissatisfaction.  On  the  other  hand,  older 
Marines  tend  to  be  mote  satisfied,  but  younger  Ma- 
nncs  are  not,  other  things  equal,  correspondingly  more 
dissatisfied.  Furthermore,  Marines  who  perceive 
better  chances  for  a  good  civilian  job  tend  to  be  more 
dissatisfied,  while  Marines  who  perceive  poorer 
chances  are  not  more  satisfied.  These  observations 
suggest  dimensions  in  which  satisfaction  and  dissatis¬ 
faction  with  military  life  are  independent. 

ORDERED  VERSUS  UNORDERED  MODELS 

In  this  particular  case,  it  appears  that  an  ordered 
model  is  not  an  unreasonable  way  to  represent  the 
variable  of  interest,  because  satisfaction  and  dissaus 
faction  with  military  life  are  directionally  opposite 
with  respect  to  the  majority  of  the  key  independent 
variables.  But  what  of  the  more  general  question  of 
when  to  use  an  ordered  model  in  preference  to  an 
unordered  one?  Of  course,  one  should  require  as  a 
necessary  condition  for  using  an  ordered  model  that 
the  underlying  phenomenon  be  consistent  with  some 
kind  of  natural  ordering.  But  beyond  this,  one  way  to 
proceed  is  to  consider  the  consequences  of  imposing 
the  wrong  structure  (3).  Suppose  that  the  loss  function 
for  incorrect  estimates  of  the  true  P,  and  P2  param¬ 
eters  is  of  die  usual  squared-error  type 

l(p;  (3)  =  (p  -  (i)2  .  (3) 

Then  the  associated  risk  of  incorrect  estimates  is 

£(l(p;p)]  =  £(p-p):  ,  (4) 

which  is  the  usual  mean-squared  error  (MSE).  It  is 
easy  to  show  that  the  risk  can  be  decomposed  into  two 
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components:  the  variance  of  the  estimate  3  around 
its  expected  value  and  the  squared  deviation  of  £(p) 
from  p  (i.e.,  the  squared  bias). 

£[1(P;  P)]  =  £[p  -  £(P)]2  +  !E(P)  -  p]2  •  (5) 

This  example  illustrates  the  point  that  the  expected 
estimation  error  has  two  components,  variance  and 
bias,  that  (often)  must  be  balanced  against  each  other. 

If  an  unordered  model  is  used  when  an  ordered 
model  is  appropriate,  tne  consequence  is  lost  statistical 
efficiency  (i.e.,  greater  variance),  since  more  parameters 


will  be  estimated  than  necessary.  On  the  other  hand,  if 
additional  structure,  in  terms  of  ordering,  is  im¬ 
properly  imposed,  the  parameter  estimates  in  general 
will  be  biased.  If  there  are  relatively  few  observations 
for  each  discrete  outcome  or  significant  uncertainty 
about  model  specification,  it  may  be  best  to  accept 
some  bias  from  using  an  ordered  specification  and 
minimize  the  number  of  parameters  to  be  estimated 
(i.e.,  to  trade  reduced  variance  against  some  bias). 
However,  when  using  large  data  sets  in  which  each 
discrete  outcome  is  represented  by  a  number  of  obser¬ 
vations  that  are  large  in  relation  to  the  number  of 
parameters  to  be  estimated,  it  probably  is  best  to  use 
an  unordered  model  and  investigate  empirically  the 
dependence  structure  among  the  discrete  outcomes. 
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